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Image Reading Device and Method for the Same 

Field of the Invention 
This invention relates to an image reading device and an image reading 
5 method to read image objects with a line sensor. Particularly, it relates to a 
device and a method for shortening image reading time and obtaining an exact 
image. 

Background of the Invention 

10 In electronic-component-mounting apparatuses, a line sensor is used as 

image reading means for recognizing a position of an object to be mounted by- 
image processing. A line sensor is formed of pixels arrayed in a line and the 
pixels are equipped with photoelectric transfer elements storing electric charges 
responsive to an amount of received light. When an optical image of an object 

1 5 is formed on the line sensor with an optical system, electric charges are stored in 
each pixel corresponding to the optical image of the object. Electric charges are 
output as an electric signal sequentially, so that one dimensional image data in 
pixel array direction, namely main scanning direction, can be obtained. 
Components are moved relative to sub scanning direction crossing main 

20 scanning direction, so that a plurality of one-dimensional data are arranged in 
parallel, whereby desirable two-dimensional image data is obtained. 
Conventionally a charge coupled device (CCD) line sensor has been used as this 
line sensor discussed above. 

Components to be mounted have various kinds and sizes. A 

25 multifunctional-component-mounting apparatus for various components 
ranging from a small size to a large size is required to read images of 
components in various sizes with one image reading device. For this reason, an 
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image reading device with a line sensor is usually equipped with a line sensor of 
which scanning width accommodates to the largest component. An image 
signal from the line sensor is stored in an image memory of the image reading 
device. 

5 However, when an image is read, a CCD line sensor used in a 

conventional image reading device is required that electric charges be 
transferred from every pixel of the line sensor regardless of a component size. 
Such a conventional method takes excess time to read image because electric 
charges are transferred from pixels carrying no necessary information. A 
10 relative moving speed in sub scanning direction is sometimes dispersed by a 
mechanical error, and resolution in sub scanning direction is also dispersed 
resulting from this dispersion. An exact image thus can't be obtained. 

Summary of the Invention 
15 It is an object of this invention to solve the problems mentioned above by 

providing an image reading device and an image reading method for shortening 
image reading time and obtaining an exact image. 

An image reading device for reading an optical image of an object using a 
camera having pixels arrayed in a line comprises the following elements: 
20 (a) a pixel-selecting section for accessing the pixels individually and 

outputting an image signal; 

(b) pixel-selecting-information-providing means for providing pixel- 
selecting information including necessary information to specify a pixel which 
outputs the image signal; 
25 (c) a relative-moving mechanism for moving the object relative to the 

camera ; 

(d) a relative-movement detector for detecting the object moving a given 
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distance in one direction relative to the camera; and 

(e) a controller for controlling the pixel-selecting section based on the 
pixel-selecting information and outputting a pixel signal supplied from a 
desirable pixel when the relative -movement detector detects a relative 
5 movement of the given distance. 

The present invention provides an image reading method for reading an 
optical image of an object using a camera with pixels arrayed in a line. The 
image reading method comprises the following steps: 

(a) moving the object by a relative-moving device in one direction 
1 0 relative to a camera; and 

(b) outputting an image signal from a specific pixel repeatedly based on 
pixel-selecting information every time the object moves a given distance. 

In this invention, even if the relative-moving device, which moves an 
image relative to the camera, has an error, a resolution becomes stable and an 
1 5 exact image is obtainable. 



Brief Description of the Drawings 
Fig. 1 is a perspective view of a component-mounting apparatus with an 
image reading device in accordance with an embodiment of the invention. 
20 Fig. 2 is a block diagram of the image reading device in accordance with 

the embodiment of the invention. 

Fig. 3 is a block diagram of a relative -movement-detecting section of the 
image reading device shown in Fig. 2. 

Fig. 4 shows a structure of a line sensor of the image reading device 
25 shown in Fig. 2. 

Fig. 5 shows one of pixels forming the line sensor of the image reading 
device in Fig. 2. 
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Fig. 6 is a timing chart explaining the function of the line sensor of the 
image reading device in Fig. 2. 

Fig. 7 is a flowchart illustrating a method of the image reading in 
accordance with the embodiment of the invention. 
5 Fig. 8 is a schematic view of determining an image-taken-in area of the 

image reading method in accordance with the embodiment of the invention. 

Detailed Description of Preferred Embodiment 
This invention will be described with reference to the accompanying 
10 drawings. 

A structure of an electronic-component-mounting apparatus incorporating 
an image reading device and a structure of the image reading device are 
described. Fig 1 is a perspective view of a component-mounting apparatus with 
the image reading device in accordance with the embodiment of the invention. 

1 5 Fig. 2 is a block diagram of the image reading device in accordance with the 
embodiment of the invention. Fig. 3 is a block diagram of a relative- 
movement-detecting section of the image reading device. Fig. 4 shows a 
structure of a line sensor of the image reading device. Fig. 5 shows one of 
pixels forming the line sensor of the image reading device in Fig. 2. Fig. 6 is a 

20 timing chart explaining the function of the line sensor of the image reading 
device. 

As shown in Fig. 1, transfer paths are disposed in X direction of a center 
of base 1. Transfer paths 2 transfer and position substrate 3. Component- 
supplying sections 4 are disposed on both sides of transfer path 2. Number of 
25 tape feeders 5 are set at each component-supplying section 4 in parallel. Tape 
feeders 5 store components held on tapes and supply the components at pick-up 
positions by pitch-feeding. 
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Two Y axis tables 61, 62 are set in parallel at both the edges of the upper 
face of base 1. X axis table 7 with transfer head 8 is set on both Y axis tables 61, 
62. Head 8 has absorbing nozzles 81, which absorb a plurality of components, 
at its bottom part (shown in Fig. 2). Since Y axis tables 61, 62 and X axis table 
5 7 are movable, head 8 moves horizontally and picks up components from pick up 
positions of tape feeders 5. 

Camera 9 for reading images of components is disposed under a moving 
route of head 8 between transfer path 2 and supplying section 4. Camera 9 
comprises a line sensor formed of pixels having photoelectric transfer elements. 
1 0 The pixels are arrayed in Y direction in series. 

An image reading device in accordance with the embodiment of the 
invention is described hereinafter with reference to Fig. 2. As shown in Fig. 2, 
components 301, 302 and 303 held by absorbing nozzles 81 of transfer head 8 
move above camera 9 sequentially, then components 301, 302 and 303 are 
15 illuminated from below with a light (not shown). Optical images of the 
components are formed on the pixels. Image signals which are converted from 
the optical images to electrical signals are output. 

In Fig. 2, motor 71 — a driving motor of X axis table 7— is controlled by 
motor controller 10. In other words, controller 10 controls motor 71 based on a 
20 speed command and a position command transmitted via input-output 
controller 19. Motor 71 rotates feed screw 72, whereby head 8 moves in a given 
pattern in X direction relative to camera 9. 

Camera 9 takes pictures while head 8 is moving, so that camera 9 obtains 
scanning images of components 301, 302 and 303. X axis table 7 has a moving- 
25 mechanism relative to Y direction (a pixel-arranged direction of line sensor of 
camera 9). X axis table 7 moves components 301, 302 and 303 (objets to be shot 
by camera 9) in X direction crossing Y direction at right angles. Scanning 
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images obtained are recognized as pictures, whereby components 301, 302 and 
303 are identified and the positions are detected. The components are mounted 
on substrate 3 after misregistrations are corrected based on the result of 
detecting positions. 

Motor 71 has an encoder (not shown). Pulse signals from the encoder are 
sent to motor controller 10. Controller 10 detects a position of head 8 by the 
pulse signals, and transmits the signals as the present position of head 8 to 
input-output controller 19. Relative-movement-detecting section 11 receives 
the pulse signals from the encoder via controller 10. Detecting section 11 
detects that components 301, 302 and 303 move a given distance in X direction 
relative to camera 9. Detecting section 11 outputs movement-detecting signal 
750 to camera-controller 17. 

Relative-movement-detecting section 11 is described hereinafter with 
reference to Fig. 3. As shown in Fig. 3, detecting section 11 has present- 
position counter 111, memory 112 for storing a position of a taken-in area in X 
direction, taken-in area determining section 113, and given- distance -movement - 
detecting section 114. Counter 111 counts pulse signals supplied from the 
"encoder of X axis motor 71 and detects the present position of head 8 in X 
direction, where the pulse signals are sent via controller 10. The present 
position detected is sent to taken-in area determining section 113. 

Memory 112 stores positional information in X direction of an image- 
taken-in area as mechanical coordinates of a relative-moving mechanism, where 
the image-taken-in area has been set by camera 9. Memory 112 also stores 
data of given distances corresponding to scanning spaces as mechanical 
coordinates of the relative-moving mechanism. The data are sent to memory 
112 via input-output controller 19. 

Taken-in area determining section 113 compares the present position sent 



from counter 111 with positional information in X direction sent from memory 
112. Determining section 113 then determines a relative-position relation 
between camera 9 and head 8. The determining section 113 outputs allowing- 
signal 760 which allows given-distance-movement-detecting section 114 to 
operate when the determining section 113 determines the components are inside 
the image-taken-in area. 

Detecting section 114 detects whether or not head 8 moves the given 
distance relative to camera 9. Detecting section 114 counts the pulse signals 
supplied from the encoder and monitors the movement of head 8 relative to 
camera 9 when detecting section 114 is allowed to operate by supplied signal 760. 
Detecting section 114 outputs movement-detecting signal 750 and resets the 
count number of the pulse signals when head 8 moves the given distance 
corresponding to the scanning space which have been set. Detecting section 
114 repeats the same operations and outputs signal 750 to camera-controller 17 
when signal 760 is output. The line sensor obtains the object images based on a 
control command of controller 17 using signal 750 as a trigger. 

The scanning space -the given distance discussed above - is a parameter 
"for specifying resolution of the pictures obtained by camera 9. A fine image is 
obtained when the scanning space is narrow. The image becomes coarse when 
the scanning space is widened. In this embodiment, since the scanning space 
can be set responsive to each image-taken-in area, desirable resolutions of 
images can be obtained corresponding to the kinds, shapes, sizes and 
recognition-grade (grade of fine resolution) of components. 

As shown in Fig. 2, camera 9 comprises line sensor 14, pixel- selecting 
circuit 15, signal-compensating section 16 and camera-controller 17. Line 
sensor 14 comprises a plurality of pixels 141 arrayed in Y direction in series. 
As shown in Fig. 4, line sensor 14 includes sample-hold section 23, first shift 
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gate 24, photoelectric transfer section 25, second shift gate 26 and reset-drain 27. 
One of plural pixels 141 forming line sensor 14 is illustrated in Fig. 5. Pixel 
141 is formed of photoelectric transfer element 251 of photoelectric transfer 
section 25, gate element 241 of first shift gate 24, gate element 261 of second 
5 shift gate 26 and storage element 231 of sample hold section 23. Each storage 
element 231 is coupled to pixel-selecting circuit 15. 

Optical images are formed on line sensor 14, whereby photoelectric 
transfer element 251 receives light and stores electric charges. Control signal 
720 is transmitted from camera-controller 17 to first shift gate 24, so that the 

1 0 electric charges of photoelectric transfer element 251 are sent to storage element 
231 via gate element 241. Supplied electric charges are stored in storage 
element 231 as a voltage value corresponding to the amount of the electric 
charges. Control signal 730 is transmitted to sample-hold section 23 before 
new electric charges are supplied, so that the voltage value stored in storage 

1 5 element 231 is reset. Control signal 710 is transmitted to second shift gate 26, 
whereby electric charges of photoelectric transfer element 251 are supplied to 
reset-drain 27 via gate element 261. As a result, electric potential of each 
"photoelectric transfer element 251 is initialized. 

Pixel-selecting circuit 15 selects one of plural pixels 141 of line sensor 14 

20 and outputs image signals from selected pixel 141. In other words, pixel- 
selecting circuit 15 outputs the voltage value stored as image signals from 
storage element 231, where the voltage value stored is selected from one of 
plural pixels 141 based on pixel-selecting information. Pixel-selecting circuit 
15 accesses a plurality of pixels 141 individually and outputs image signals. 

25 Pixel-selection is operated by controlling pixel-selecting circuit 15 based on 
control signal 740 from camera-controller 17. 

Image signals from the selected pixel by the pixel-selection are supplied 
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using movement-detecting signal 750 as a trigger supplied from relative- 
movement-detecting section 11. Camera-controller 17 controls a pixel-selecting 
section (pixel-selecting circuit 15) based on pixel information when detecting 
section 11 detects that head 8 moves the given distance relative to camera 9. 
5 As a result, camera-controller 17 outputs image signals from a desirable pixel. 

A function of line sensor 14 is described hereinafter with reference to Fig. 
6. Fig. 6 shows working condition of elements forming line sensor 14, such as 
second shift gate 26, photoelectric transfer section 25, first shift gate 24 and 
pixel-selecting circuit 15. The working condition is related to movement- 

10 detecting signal 750 supplied from relative-movement-detecting section 11 and 
shown in the timing chart. Fig. 6 shows control signals 710, 720, 730 and 740 
the same as shown in Fig. 4. In Fig. 6, step signals of control signals 710 and 
720 show the open-state timings of second shift gate 26 and first shift gate 24 
respectively. Control signal 730 shows the timings of holding and releasing 

1 5 voltage value of sample-hold section 23. 

Control signal 740 shows the timing when image signals are output 
sequentially from storage element 231. A period from the first step signal to 
"the last step signal shows image-signal-output time, i.e., necessary time for 
outputting image signals from all the selected pixels. A step signal of 

20 movement-detecting signal 750 shows an output timing from relative- 
movement-detecting section 11. 

A hold-release signal is output on control signal 730 when movement- 
detecting signal 750 is supplied from relative-movement-detecting section 11 
(arrow-mark 1), whereby a holding state of sample-hold section 23 is released. 

25 An open signal is output on control signal 720, then first shift gate 24 becomes 
an open state (arrow-mark 2). As a result, electric charges of photoelectric 
transfer section 25 are sent to sample-hold section 23. A hold signal is output 
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on control signal 730, and sample-hold section 23 restores to the holding state 
again (arrow-mark 3). Transmitted electric charges are stored as a voltage 
value in sample-hold section 23. 

A closing signal is output on control signal 720 and first shift gate 24 
5 becomes a closed state again when sample-hold section 23 becomes a holding 
state (arrow-mark 4). A closing signal is output on control signal 710, whereby 
second shift gate 26 becomes an open state (arrow-mark 5). An electric charge 
state of photoelectric transfer section 25 is reset. Photoelectric transfer section 
25 restarts light exposure at the timing when second shift gate 26 becomes the 
10 closed state again. Pixel-selecting circuit 15 outputs the voltage value as an 
image signal sequentially, following control signal 740 supplied based on pixel- 
selecting information, in parallel with light exposure (arrow-mark 6), where the 
voltage value has been stored in storage element 231. 

Interval T (a period from a signal to the next signal of movement- 
1 5 detecting signal 750) is not necessarily the given period. Dispersion of interval 
T occurs by a mechanical error, e.g., an error of feed screw 72. Movement- 
distance of head 8 relative to camera 9 is kept constant regardless of mechanical 
~ "errors during interval T. Time margin is set between end of an image-signal- 
output and start of the next image-signal-output from sample-hold section 23 in 
20 order to reduce dispersion of interval T. 

In Fig. 2, image signals are output from respective pixel 141 of line sensor 
14 based on pixel selecting operation and sent to signal-compensating section 16. 
Compensating section 16 compensates image quality based on camera-set-up- 
value, e.g., gain, where the camera-set-up-value is supplied from camera- 
25 controller 17. Camera-controller 17 receives pixel-selecting information, i.e., 
necessary information for driving pixel-selecting circuit 15, from input-output 
controller 19 and controls pixel-selecting circuit 15 based on the pixel-selecting 
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information. Controller 17 outputs image signals from pixel 141 selected by 
pixel-selecting information and outputs a signal indicating a completion of 
taking-in a picture. 

Image signals compensated by compensating section 16 are supplied to 
5 image-recognizing section 18. When recognizing section 18 receives the 
taking-in-completion signal supplied from controller 17, recognizing section 18 
recognizes the taken-in image signals according to recognition algorithm 
designated by an algorithm number included in components data. 

Input-output controller 19 is linked with motor-controller 10, relative- 
1 0 movement-detecting section 11, camera-controller 17, image-recognizing section 
18 and processing-computing section 20. Controller 19 thus controls inputs 
and outputs of signals. Processing-computing section 20 executes processing 
programs stored in program-memory 22 based on data stored in data-memory 
21. 

15 Mounting data 211 and component data 212 are stored in data-memory 

21. Data 211 are data regarding mounting processes, e.g., mounting positions 
of components, sequence of mounting of the components and kinds of nozzles 
used for picking up the components. Data 212 are database of various data for 
the components. Data 212 include data of shapes and sizes of the components, 

20 algorithm numbers added to algorithm used for recognition of the components, 
recognition parameters and so on. Taken-in area determining program 221 
and mounting-operation program 222 are stored in program-memory 22. 
Program 221 determines sizes of image-taken-in area and scanning spaces 
based on the sizes and the shapes of the components in the component data. 

25 Program 221 outputs the information (the sizes and the spaces) as numerical 
values indicating pixel-selecting information and positions in X direction. 

A method of mounting components according to this invention is described 
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as follows. Fig. 7 is a flowchart illustrating a method of the image reading in 
accordance with this embodiment. Fig. 8 is a schematic view of determining an 
image-taken-in area of the image reading method in accordance with the 
embodiment of the invention. 
5 Processing-computing section 20 reads mounting data 211 and component 

data 212 from data-memory 21 (STl). Mounting operation is started and head 
8 in Fig. 1 picks up the components from component-supplying section 4 (ST2). 
As shown in Fig. 8, three different kinds of components 301, 302 and 303 are 
picked up with absorbing nozzles 81. Head 8 moves to image-reading-starting 

1 0 position above camera 9 (ST3). 

The following process is operated at the same time of operation of head 8. 
A taken-in area determining process is operated based on mounting data 211 
and component data 212 (ST4). Program 221 is executed by processing- 
computing section 20, whereby image taken-in areas 501, 502 and 503 are 

1 5 determined corresponding to components 301, 302 and 303 which are held by 
head 8 as shown in Fig. 8. 

In Fig. 8, numerical values (Yl, Y2 -"Y6) in Y direction marked in 
"respective image-taken-in areas are based on numerical values (Y0-"Ye) of 
arrayed pixels in line sensor 14. The numerical values (Yl, Y2 "-Y6) show 

20 widths of image-taken-in areas (pixel areas selected as objects to be output and 
forming image signals) of reading images. When an image of image-taken-in 
area 501 corresponding to component 301 is read, an image signal from pixels 
between Yl and Y2 out of a plurality of pixels 141 (Y0-"Ye) in line sensor 14 is 
output. 

25 Numerical values (XI, X2 ••• X9) in X direction corresponding to 

respective image-taken-in areas show numerical values on mechanical 
coordinates of a relative-moving mechanism which moves head 8 in X direction. 
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For example, the numerical values (XI, X2 "-X9) correspond to pulse numbers 
supplied from the encoder of motor 71, where (X3, X4), (X5, X6) and (X7.X8) 
show respective start- and stop -timing of reading image-signals for image- 
taken-in areas 501, 502 and 503. Numerical values XI, X2 and X9 show 
5 timings of acceleration and deceleration at scanning operation of head 8. 

In Fig. 8, numerical values on X axis in X direction correspond to a 
relative-position relation between line sensor 14 and head 8 in X direction. A 
positional relation between line sensor 14 and head 8 moving horizontally is 
1^ determined by the numerical values. Agreement between positional 

3 10 information (a pulse signal) from the encoder of motor 71 and numerical value 
m XI means that head 8 reaches a given deceleration position to realize a given 

■i scanning speed. Numerical value X2 corresponds to a speed-determining 

ill 

, position where head 8 finishes decelerating and moves at a given scanning 

ill speed. 

\2 15 Processing-computing section 20 monitors positional information 

l1 supplied from the encoder of motor 71 via motor controller 10. When the 

positional information agrees with the numerical values discussed above, 
section- 20 detects that the specific relative-position relations corresponding to 
respective numeral values are realized. Various operation controls, e.g., 
20 driving-control of head 8 and updating of pixels to be selected (from these pixels 
an image signal is output) in line sensor 14, are carried out responsive to the 
detected results. 

Respective numerical values for image-taken-in areas 501, 502 and 503 in 
Y and X directions are determined based on shapes and sizes in the data of the 
25 components. The numerical values in Y direction show widths and sizes of 
image-taken-in areas. The numerical values in X direction show start- and 
stop-timing of image signals. Pixel-selecting-information which selects pixels 



14 



(pixels from which an image signal is output) is produced based on the image- 
taken-in areas. Then the pixel-selecting-information is output (ST5), which 
allows camera 9 to be ready for reading images. Then images are read (ST6). 

Processing-computing section 20, data-memory 21 and program-memory 
5 22 form pixel-selecting-information-supplying means which supplies pixel- 
selecting-information including necessary information to specify pixels (pixels 
from which an image signal is output). 

Images are read as follows. As shown in Fig. 8, in the case of the image- 
taken-in area 501 which is taken in first, the pixels between Yl and Y2 out of a 
1 0 plurality of pixels 141 (Y0 • ■ • Ye) of line sensor 14 are selected to be output. 

When positional information showing the position of head 8 agrees with 
X3, allowing-signal 760 is output from taken-in area determining section 113 of 
relative-movement-detecting section 11. Given-distance-movement-detecting 
section 114 outputs movement-detecting signal 750 to camera-controller 17, 
1 5 where signal 750 shows that head 8 moves a given distance (a scanning space) 
relative to camera 9. 

Image signals from line sensor 14 are output using movement-detecting 
signal 750 as a trigger. The image signals are taken in image-recognizing 
section 18 via signal-compensating section 16. When head 8 moves and 
20 positional information agrees with X4, taken-in area determining section 113 
stops outputting allowing-signal 760. An output of movement-detecting signal 
750 is thus stopped and reading image by camera 9 is stopped. Head 8 moves 
further and images are read in the same manner repeatedly for image-taken-in 
areas 502 and 503. Different scanning spaces are determined for respective 
25 image-taken-in areas 502 and 503, so that images having resolutions 
corresponding to components 302 and 303 can be obtained. 

When reading images for all components are finished, head 8 moves 
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above substrate 3 (ST7). Recognizing process is operated at the same time 
(ST8). In other words, the image signals compensated at signal-compensating 
section 16 are supplied to image-recognizing section 18 and recognized. The 
components are mounted (ST9). To be more specific, misregistrations of 
5 components 301, 302 and 303 are corrected based on the recognition results by 
image-recognizing section 18. The components are mounted on substrate 3 by- 
head 8. Components 301, 302 and 303 are recognized at proper resolutions 
corresponding to respective components, and yet, recognized based on a stable 
image free from dispersion of the resolution. As a result, accuracy of image 
iTj 1 0 recognition becomes stable and mounting accuracy can be improved, 
y In this embodiment, the image reading device is built in the component- 

|yt- mounting apparatus; however, this image reading device can be used in any 

u apparatuses which read images, e.g., assembling apparatus and inspection 

iij machines. 

p 1 5 According to the present invention, objects move in one direction relative 

to the camera by the relative -moving mechanism, and image signals from pixels 
are output by pixel-selecting-information repeatedly every time the objects move 
relative to the camera. As a result, dispersion of the resolution resulting from a 
mechanical error is reduced, and resolution becomes stable and an exact image 
20 is obtainable. 



